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Abstract 

This paper presents a novel optimization method named state transition algo- 
rithm (STA) to solve the problem of identification and control for nonlinear 
system. In the proposed algorithm, a solution to optimization problem is 
considered as a state, and the updating of a solution equates to the process 
of state transition, which makes the STA easy to understand and convenient 
to be implemented. First, the STA is applied to identify the optimal pa- 
rameters of the estimated system with previously known structure. With 
the accurate estimated model, an off-line PID controller is then designed 
optimally by using the STA as well. Experimental results demonstrate the 
validity of the methodology, and comparison to STA with other optimization 
algorithms confirms that STA is a promising alternative method for system 
identification and control due to its stronger search ability, faster convergence 
speed and more stable performance. 

Keywords: Nonlinear system identification; PID controller; State 
transition algorithm; Optimization algorithms 



1. Introduction 

The identification and control of nonlinear system have been widely stud- 
ied in the recent years. Before the design of a controller, it is necessary to 
achieve system identification. In general, the process of system identification 
can be composed into two steps: the selection of an appropriate identifica- 
tion model(system structure) and an estimation of the model's parameters, 
of which, the parameter estimation plays a relatively more important role 
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since a specific class of models that can best describe the real system can 
usually be derived by mechanism analysis of industrial pro cesses 

As for techniques of parameter estimation, approaches such as least- 
squares method, instrumental variable method, correlative function method, 
and maximum-likelihood method are widely utilized ji], [sj. Especially for the 
least-squares method, it has been successfully used to identify the parame- 
ters in the static and dynamic systems]^. However, most of these techniques 
have some fundamental problems including their dependence on unrealistic 
assumptions such as unimodal performance and differentiability of the per- 
formance function as well as getting trapped into local optimum, because 
these methods are in essence local search techniques based on gradient. For 
example, the least-squares method is suitable for the model structure of sys- 
tem possessing linear property. Once the form of model structure exhibits 
nonlinear performance, this approach often fails in the search for global op- 
timum and becomes ineffective[ll, 0, S Isj . 

Fortunately, the modern intelligent optimization algorithms, such as ge- 
netic algorithm(GA) j6|,0], particle swarm optimization(PSO)0,0], are global 
search techniques based not on gradient, and they have been successfully ap- 
plied in various optimization problems even with multimodal property. As 
a matter of fact, some intelligent optimization algorithms have been utilized 



in the field of nonlinear system identification and control. In [10[, estima- 
tion of bar parameters with binary-coded genetic algorithm was studied, 
and it was verified that the GAs can produce better results with respect to 
most deterministic methods. Genetic algorithm based parameter identifica- 



tion of a hysteretic brushless exciter model was also proposed in In 
l^l, [isj , real-coded genetic algorithms were applied for nonlinear system iden- 
tification and controller tuning, and the simulation examples demonstrated 
the effectiveness of the GA based approaches. Then, in [H, lil [sl, parame- 
ter estimation and control of nonlinear system based on adaptive particle 
swarm optimization were presented, and examples confirmed the validity of 



the method. Further more, in 13 , identification of Jiles-Atherton model 



parameters using particle swarm optimization, and in parameters iden- 



tification for PEM fuel-cell mechanism model based on effective informed 
adaptive particle swarm optimization were put forwarded subsequently. All 
of these indicate that intelligent optimization techniques are alternatives for 
traditional methods including gradient descent, quasi- Newton method, and 
Nelde-Mead's simplex methods. 

Although GA and PSO are hopeful approaches for the problem, they al- 
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ways encounter premature convergence and the convergence rates of them are 



not so satisfactory when deahng with some complex or multimodal functions [15 



16| . State transition algorithm(STA) is a novel optimization method based 



on the concept of state and state transition recently, which originates from 



the thought of space transformation [171. Il8l| . In STA, four special transforma- 
tion operators are introduced, and they represent different search functions 
in space, which makes the STA easy to understand and convenient to im- 
plement. For continuous function optimization problems, STA has exhibited 
good search ability compared with other stochastic algorithms pLSj. 

This paper introduces STA to identify the optimal parameters of nonlin- 
ear system firstly. Then, it will also discuss the off-line PID controller design 
by adopting STA according to the estimated model. The reason of using PID 
controllers is due to its ease of use, good stability and simple realization. The 
key issue for PID controller design is the accurate and efficient tuning of PID 
control gains: proportional gain Kp, integral gain Ki and derivative gain 
Kd- For adjusting PID controller parameters efficiently, many methods were 
proposed. The Ziegler-Nichols method is an experimental one that is widely 
used; however, this method needs certain prior knowledge regarding plant 



model[19[. Once tuning the controller by Ziegler-Nichols method, a good 
but not optimum system response will be gained. On the other hand, many 
artificial intelligence techniques such as neural networks, fuzzy systems and 
neural-fuzzy logic have been widely applied to the appropriate tuning of PID 



control gains[20[. Besides these methods, modern intelligent optimization 
algorithms, such as GA and PSO, have also received much attention for this 
problem, and they are used to find the optimal parameters of PID controller. 

The goal of this paper is to introduce a novel method STA for both pa- 
rameter estimation and control of nonlinear systems simultaneously. In order 
to evaluate the performance of the STA, experiments are carried out to tes- 
tify the validity of the proposed methodology, the results of which confirm 
that STA is an efficient method for both parameter identification and con- 
trol of nonlinear system. Compared with other optimization algorithms, the 
simulated examples demonstrate that the STA has superior features in terms 
of search ability, convergence speed and stable performance. 

2. Problems description 

To transform a specified problem into the standard type of optimization 
problem is called mathematical modeling, which is the basis for optimizing or 
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parameter identification. The standard optimization problems should consist 
of objective function and decision variables, while the algorithms are used to 
find the optimum solution (variable) for the objective function. 

2.1. Identification of nonlinear system 

In this paper, the following class of discrete nonlinear systems described 
by the state space model are considered: 

yik) ^h{k,x{k),uik),P2) ^' 

where x E is the state vector, u e R is the input, y e R is the out- 
put. Pi and P2 are unknown parameter vectors that will be identified, and 
/(■) and /i(-) arc the nonlinear functions. Without loss of generality, let 
9 = [9i,02, - ■ ■ ,6n] be a rearranging vector containing all parameters in Pi 
and P2 where n represents the total number of unknown system parameters. 
Furthermore, the estimated system model can be described as: 

x{k + l) = fik,xik),u{k),Pi) 
y{k) =h{k,x{k),<k),P2) 

where x G P" and y E R denote the state vector and the output of the model. 
Pi and P2 are the estimated parameter vectors, respectively. Accordingly, 
let 9 = [6*1, 6'2, • • • , 6*^] be the estimated rearranging vector. 

The basic thought of system identification is to compare the real system 
responses with the estimated system responses. Moreover, to accurately 
estimate the 9, some assumptions on the nonlinear systems are requested: 

(1) The system output must be available for measurement. 

(2) System parameters must be connected with the system output. 

To deal with the problem of parameter estimation, the specified problem 
should be formulated as an optimization problem. In this study, the decision 
variables are the estimated parameter vector 9, while the objective function 
is chosen as the following mean squared errors(MSE): 

1 ^ 1 

MSE=^5^e2 = ^[^(A:)-X(^)P (3) 

k=l 

where is the length of sampling data, X{k) = [x{k),y{k)] and X{k) — 
[x{k),y{k)] are real and estimated values at time k, respectively. 
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It is obvious to find that the MSE is the function of variable vector 9, 
and then, the objective function will be solved by the global optimization 
algorithms which will minimize the MSE value so that the real nonlinear 
system is actually estimated. The block diagram of the nonlinear system 
parameter estimation is given in Figure [H 
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Figure 1: The estimation process 



2.2. Design of PID controller 

When the nonlinear system model is estimated, an off-line PID controller 
is then designed to guarantee the stability and other performances of the 
system. The reason why the PID controller is adopted is that it is the most 
widely used controller for application in industrial process. The continuous 
form of a PID controller can be described as follows: 

u{t) = K,[e{t) + ^ £ e{t)dt + T,j^e(t)] (4) 

where, e{t) is the error signal between the desired and actual outputs, u{t) is 
the control force, i^p, Tj, Td are the proportional gain, integral time constant 
and derivative time constant, respectively. By using the following approxi- 
mations: 

!le{t)dt^TY.U<^) ... 

~ e(fc)-e(fc-l) (.O; 
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where, T is the samphng period, then (5) can be rewritten as 

k 

u{k) = KMk) + ^ E eU) + - e{k - 1)]} (6) 

* j=0 

which is called the place type, and in most case, the increment style as 
described following is more practical: 

u{k) = u{k - 1) + Kp{[e{k) - e{k - 1)] + Je(fc) + ^[e{k) - 2e{k - 1) + e{k - 2)]} 
= u{k - 1) + Kp[e{k) - e{k - 1)] + Kie{k) + Kd[e{k) - 2e{k - 1) + e{k - 2)] 

(7) 

where, Ki and Kd are integral gain and derivative gain, respectively. 

The block diagram of the design of an off-line PID controller is illustrated 




1 — I — r 



PID 

Controller 


u(k) 


Pbnt 


— ¥ 



m 



Figure 2: The design of PID controller 



in Figure[2l where yr{k) is the reference output, and y{k) is the system output 
at the sampling point. Optimization algorithms are used to adjust the PID 
controller parameters such as Kp, Ki and Kd. In the same way, mean squared 
errors will be defined as the objective function 

1 ^ 1 

MSE = ^5^e^ = ^[?/.(^)-2/(^F (8) 

k=l 
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3. State transition algorithm 



Considering the following unconstrained optimization problem: 

min f{x) (9) 

where / : i?" ^ i? is a objective function. In a numerical way, the iterative 
method is adopted to solve the problem, the essence of which is to update 
the solution found so far. When thinking in state and state transition way, 
a solution can be regarded as a state, and the updating of a solution can be 
considered state transition process. 

Based on the thought stated above, the form of state transition algorithm 
can be described as follows, 

Vk+i = f{xk+i) 

where Xk stands for a state, corresponding to a solution of the optimization 
problem; and are state transition matrixes, which are usually trans- 
formation operators; Uk is the function with variables Xk and history states; 
/ is the objective function or evaluation function. 

Using various types of space transformation for reference, four special 
state transformation operators are defined to solve continuous function opti- 
mization problems. 

(1) Rotation transformation 

Xk+l = Xk + a—r 77-RrXk (11) 

n\\xk\\2 

where Xk G 3?"^^, a is a positive constant, called rotation factor; Rr G 3?"^", 
is random matrix with its elements belonging to the range of [-1, 1] and || • II2 
is 2-norm of a vector. It has proved that the rotation transformation has the 
function of searching in a hypersphere[17,18]. 

(2) Translation transformation 

Xk+l ^ Xk + pRtj. TT- (12) 

\\Xk — Xk-l II2 

where /3 is a positive constant, called translation factor; Rt E is a random 
variable with its elements belonging to the range of [0,1]. It has illustrated 
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the translation transformation has the function of searching along a line from 
Xk-i to Xk at the starting point x^, with the maximum length of /3[17,18]. 

(3) Expansion transformation 

Xk+l = Xfe + ^ReXk (13) 

where 7 is a positive constant, called expansion factor; G ^'^^"'is a random 
diagonal matrix with its elements obeying the Gaussian distribution. It has 
also stated the expansion transformation has the function of expanding the 
elements in Xk to the range of [-00, +00], searching in the whole space[17,18]. 

(4) Axesion transformation 

Xk+l = Xfe + 5RaXk (14) 

where 5 is a positive constant, called axesion factor; Ra G 3?"^" is a random 
diagonal matrix with its elements obeying the Gaussian distribution and only 
one random index has value. As illustrated in [18], the Axesion transforma- 
tion is aiming to search along the axes. 

When using these transformation operators into practice, an important 
parameter called search enforcement (S'i?) is introduced to describe the times 
of certain transformation. 

The procedures of the current version of state transition algorithm can 
be outlined in the following pseudocode. 



Initialize feasible solution a;(0) randomly, set a, (3,^,6, and /c 
repeat 

if a < CKjnin then 

a amax 
end if 

k ^ k + 1 

State •<— op-expand{x{k — 1), SE, 7) 
if min f (State) < f{x{k - 1)) then 
Updating x{k — 1) 

State <r- op_translate{x{k — 1), SE, /3) 
if min f {State) < f{x{k — 1)) then 

Updating x{k — 1) 
end if 
end if 

State •<— opjrotate{x{k — 1), SE, a) 
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if mill f (State) < f{x{k - 1)) then 
Updating x{k — 1) 

State <r- op_transla,te{x{k — 1), SE, 13) 
if mill f (State) < f{x{k — 1)) then 

Updating x{k — 1) 
end if 
end if 

State 4- op-axes{x{k — 1), SE, 5) 
if min f {State) < f{x{k — 1)) then 
Updating x{k — 1) 

State -<— opJranslate{x{k — 1),SE, /3) 
if min /{State) < f{x{k - 1)) then 

Updating x{k — 1) 
end if 
end if 

x{k) x{k - 1) 



until the specified termination criterion is met 



where fc is a constant coefficient used for lessening the a. Operators such as 
opjrotate{-),opJ.ranslate{-),op-expand{-) and op-axes{-) correspond to the 
rotation, translation, expansion and axesion respectively, and the translation 
operator will only be performed when a better solution is obtained. 



4. Experimental results 

For both the identification of nonlinear system and the design of off-line 
PID controller, when the optimization algorithms are utilized, they help to 
minimize the mean squared errors(MSE). In other words, the MSE or the 
evaluation of the objective function will guide the search of the algorithms. 
Different from methods based on gradient, the termination criterion of intel- 
ligent optimization algorithms usually are not the precision of the gradient 
but a prespecified maximum iterations. 

For comparison, the maximum iterations, population size or search en- 
forcement are the same, and they are fixed at 100 and 30, respectively. To be 
more specific, in PSO, Ci — C2 — 1, and w will decrease in a linear way from 
0.9 to 0.4, as suggested in [6]. In STA, the rotation factor a will decrease 
in an exponential way with base fc = 2 from a^ax = 1 to — le~^. 
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and translation factor /3, expansion factor 7, axesion factor 5 are all constant 
at 1. For GA, we use the MATLAB genetic algorithm toolbox vl.2 from 
http: / /www.sheffield. ac.uk/ acse/research/ecrg/ getgat.html , 
In this paper, the following nonlinear system is studied: 

xi{k + 1) = 9iXi{k)x2{k) , xi{0) = 1, 

X2{k + 1) = e2xlik) + U{k), X2{0) = 1, (15) 

y{k) = esX2{k) - 9,xl{k) 

where, 6i, - ■ ■ ,64 are to be estimated. The real parameters of the nonlinear 
system are assumed to be 6* = [6*1, 62, 6*3, 6*4] = [0.5, 0.3, 1.8, 0.9]. 

The relative variables used in optimization algorithms are given as follows 
^1 G [0, 2], ^2 e [0, 2], ^3 e [0, 219, e [0, 2], = 8. 

Considering the randomness of the stochastic optimization algorithms, 
30 independent trials are run. In the meanwhile, some statistics, such as 
best(the minimum), mean, worst(the maximum), standard deviation(st.dev), 
are used to evaluate the performance of the algorithms. 



Table 1: Best estimated parameters 



Algorithms 


Oi 


O2 


^3 




GA 


0.4981 


0.2995 


1.7946 


0.8946 


PSO 


0.5000 


0.3000 


1.8000 


0.9000 


STA 


0.5000 


0.3000 


1.8000 


0.9000 



Table [Ulists the best estimated parameters gained by GA, PSO and STA, 
from which, we can find that only PSO and STA can achieve the accurate 
parameters of the real system, and the results obtained by GA are a little far 
from the real parameters. Then, from Table [21 it indicates that STA is the 
most stable algorithm for the problem because the mean and st.dev of STA 
are the smallest. It can also be found the results gained by GA and PSO are 
not so satisfactory since the best is deviated from the mean seriously. 

Figure [3] illustrates the optimization process of parameter estimation by 
using STA compared with other two algorithms in a middle run. It is easy 
to find that the convergence rates of STA are much faster than that of GA 
and PSO, with no more than 30 iterations, and the changes of parameters 
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Table 2: Performance comparison 



Algorithms 


Best 


Mean 


Worst 


St.dev 


GA 


9.6674E-07 


1.2572E-04 


4.3492E-04 


1.4433E-04 


PSO 


1.3938E-12 


2.8000E-03 


2.7700E-02 


8.4000E-03 


STA 


5.2364E-12 


5.2367E-11 


1.3729E-10 


3.5120E-11 




(C) 03 (d) 04 

Figure 3: Trajectories of parameter 61,62, 63, and 64 for comparison. 
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with STA are also steadier than other two algorithms. 

Then, with the estimated model, a off-line PID controller for this system 
will be designed by using STA, too. As a optimizer, STA is to minimize the 
square error between the plant output y and the desired output yr- In the 
experiment, relative variables are given by 

iTpG [0,l],ir, e [0,1],K, G [0,1],!/, = 2,A^ = 50. 

Also, in the same time, 30 independent trials are carried out, and some 
statistics are used to describe the performance of the algorithms. Table [3] 
shows the parameters of PID controller under the best performance, and 
Table H] gives the detailed statistical results obtained by three algorithms. 
Compared with GA and PSO, from Table HJ it is obvious to find that STA 
can find the minimum MSE with a higher probability, which shows that STA 
is much more appropriate for the problem. 

Figure H] illustrates the convergence process of PID controller parameters 
and the changes of states and output under best MSE using STA, which shows 
that the convergence rate is fast, and the changes of output indicate that the 
stability of nonlinear system is well under the proposed PID controller. To 
be more specific, for the nonlinear system, it can be found that Xi is stable at 
0, X2 is stable at 1.1111, and y is stable at 2 finally, which can be understood 
easily by analyzing the system. 



Table 3: Best parameters of PID controller 



Algorithms 






Kd 


GA 


0.1459 


0.3398 


0.0908 


PSO 


0.1447 


0.3407 


0.0919 


STA 


0.1445 


0.3410 


0.0922 



Table 4: Performance comparison of PID controller 



Algorithms 


Best 


Mean 


Worst 


St.dev 


GA 


4.9978 


5.0085 


5.0627 


0.017 


PSO 


4.9978 


5.6338 


15.4453 


1.9863 


STA 


4.9978 


4.9978 


4.9978 


1.41E-09 
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(a) (b) 

Figure 4: (a) depicts the convergence of PID controller parameters Kp^ 
and with STA, (b) shows the changes of states and output under the best 
parameters with STA. 

5. Conclusion 

In this paper, a new optimization algorithm named STA is applied to solve 
the problems of parameter estimation and controller design for a nonlinear 
system. Using as optimizer, STA is used to achieve the accurate model, and 
then it is adopted to obtain the optimal off-line PID controller. The exper- 
imental results confirm the validity of proposed algorithm. By comparison 
with GA and PSO, it is found that STA has stronger global search capability 
and are more stable in statistics. With regard to the convergence rate, it is 
also discovered that STA is much faster than its counterparts. As a novel 
optimization method, the application of STA shows that it is a promising 
alternative approach for system identification and control. 
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